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1- Introduction 


N4tiy problem .solving tasks, such as computer progr ammi ng , may be 
Character lied 44 the design of artifacts. This paper provide 5 an overview of the 
Authors 1 recent research gn SPADE (Structured Hanning and Cebugging), a theory 
of this design process. Our purpose here is to provide a coherent overall 
framQworft. Each topic introduced u covered in greater detail elsewhere 
[Goldstein & Hiller 1976a t hi Hiller a Goldstein 1976b,c,d]. 

Figure 1 Illustrates cur perspective on the construction of Information 
processing theories of cognition. We view this enterprise fl-S tliVOlving 
normative, AynthetiCj find analytic aspects, tfe see it as representing a now 
paradigm, based upon a marriage of methods and goals from several traditional 
disciplines, including artificial intelligence, psychology, pedagogy, and 
computer science. 

1.1. Objectives And Htthedplpuys bur own research project may be viewed 
as an instantiation of this general paradigm. With sub-projects addressing all 
three aspects (figure Z). As shown by the central circle in the diagrao, we seek 
to construct a computational theory pf the design process, Ve wish to tast the 
utility and validity of this theory, SPADE, in a variety of contexts. Thu leads 
to specific goals and methods, represented by the litres outlying circlos in the 
diagram, which span the synthetic, analytic, and normative aspects and 
applications Of the theory, 

K The synthetic (Al) goal is to explore computational theories of problem 
solving and learning. The method is to construct programs that anhody 
these theories. This concern is reflected in our work on PATH 
[Goldstein S Hiller 1976b], a prcblen solving program which will plan and 
debug simple blocks world and graphics programs. The support for an AI 
thoory is determined primarily by the camuatenco and efficiency of the 
associated computer program in perforaing a prescribed set of tasks. 
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FIGURE 1 - INFORMATION PROCESSING THEORIES OF COGNITION 
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FIGURE 2 - A LINGUISTIC THEORY OF LESION AS PLANNING 4 DEBUGGING 






ANALYTIC ASPECT 


SYNTHETIC ASPECT 


THE SPADf 
THEORY 


A LINGUISTIC 
^THEORY OF DESIGN 
IS PLANNING S 
1EBUGGING 


NORMATIVE ASPECT 

















Overview 


% 


ni 11or & Goldstein 


Z, Hid analytic (psychological) goal |j to account for the knowledge states 
and learning strategies of individuals, Our method is to analyze 
protocols of subjects interacting with precisely controlled computer 
environments as they solve some problem [Milter * Goldstein 1975b). Wo 
seefc to nodal the subject's current knowledge, not only About the 
particular domain, but also about planning and debugging strategies. 
PAZATN fNlller & Goldstein 197Gd], a system to analyze ola ment a ry 
programing protocols end .reveal the use of various plans and debugging 
techniques, incorporates this concern. A theory pf design embedded in an 
automatic protocol analyser is supported to the extent to which it can 
describe and predict the subject's responses: both the final solution 
and observable details of the design process by which that solution is 
f oun d - 


3. "I he normative (educational) g?al is to prescribe design methodology for 
buth students (such as beginning programmers) and expert human problem 
solvers (such as professional programmers). This is partly a pedagogical 
concern: we wish to experiment with the SPADE theory as the basis Fur a 
curriculum about problem solving, At the sane time, it shares %h% 
Structured programming movement's concern to improve the quality and 
reliability of software. The former concern is explored through the 
design for SHERLOCK [Goldstein 4 Miller 1076a),. an hypothetical computer 
tutor which embodies our vision of flexible, sensitive uses of computers 
to teach problem solving and enhance education. The latter concern is 
explored via the SPADE editor [Miller £ Goldstein 1976c], a grammar-based 
envlronneni, to assist beginning programmers ip acquiring* and 
professional programmers in adhering to, a top-down, structured design 
discipline. These systems, like PATH and PAZATN, though potentially 
valuable as applications programs d are mainly intended as experimental 
Luo Is for testing the £PAPB theory. Tha experiment a f nethcdology Is to 
systematically vary the operation of the learning or programming 
Environment. Th« claims of tho theory are supported to the extent to 
which the system as a whole (as well as its various components) elrl(s) 
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the user in solving harder problems mam iruickly. 


Conblning these methods and goals into a single research program has 
powerful synergistic effects. We have realized this in our Particular projects 
through the development of a unifying linguistic theory Of design. 

l,Z, A Linguistic Analogy; In developing a formalism for representing 
problem solving techniques, we have hash guided by a novel perspective; an 
analogy to computational linguistics. We have found this analogy to be fruitful 
for several reasons. 

1- Computational lingu)sties, though intended to Illuminate the nature of 
language per se, has produced a set of concepts and algorithms for 
characterizing and explaining complex computational processes which are 
both, perspicuous and rich in power. Problem solving, as a complex 
process, benefits from the application of these toels- 

Z- ‘Computational linguistics decomposes computations into syntactic* 
semantic, and pragmatic components. This decomposition clarifies the 
explanation of complex processes t when viewed lit the following manner; 
syntax formalizes the range Of possible decisions; Semantics the prob1era 
description, and pragmatics the relationship between the two, 

3- Computational linguistics has Undergone an evolution of pro-Cedtlral 
formalisms, beginning with finite state automata, later employing 
recursive transition networks (context free grammars), next moving on to 
augmented transition networks, and culminating in the current set of 
theories involving frames. etc. Fallowing this evolutionary sequence In 
language theories illuminates their complexity. Each phase Captured sene 
properties or language, but was incomplete and required general Untied to 
more powerful and elaborate formalisms, tloreover, the interrelationships 
among many of these formalisms have been thoroughly delineated. 
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From this evolutionary perspective, one need not necessarily view & given 
StHflO of theorizing as wrong, Sometimes an earlier theory is wrong, but in Other 
cases the earlier approach can be valuable as an abstraction in its cun right, 
which illuminates some dimension of the phenomena, even though it is inadequate 
as a complete theory, We are following a sequence parallel to that exhibited by 
computational linguistics in our own study of problem solving. 

In this evolutionary development or 5PADE t our theory ef the design 
process, two sub-tasks have been addressed. First, we have analyzed certain 
intricacies ef planning and debugging, such as are encountered in the design or 
programs which must take Into account Interactions in achieving dependent 
sub goals. The Second sub-task has been to seek, a representational Framework In 
which to elucidate these subtleties, and irt which to structure a wide variety cf 
planning techniques, Our Approach has been to begin with simple but clear 
fomalisns, studying their virtues and limitations. Our plan is to continue to 
investigate a series of progressively more powerful and elaborata 
representations, after reaching a solid understanding as l& where the extra power 
is needed, and why. 

To date, we have explored COUEflXt free planning grammars, and their 
generalization to ATM'S! have traosferrad the insight gained TrOm studying 
planning to the development of a model ef debugging; we have examined the 
metaphor of protocol hei a lysis as parsing, and studied the use of a chart parser 
as a meaos to- discovering these analyses, 

2. A Linguistic Theory of Pla n nin g 

The center circle of figure 2 provides the setting for the discussion in 
this section and the next, Thun, having introduced some basic notions of the 
SPADE theory of design, wg will be In a position to move to the peripheral 
aspects (the outer circles) in sections four, five ind six. 
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jLJL_A Ta xonomy of Plan n ing Concepts; The basis for SPADE is a taxonomy 
of frequently observed planning concepts {figure 3), Vn arrived at this taxonomy 
partly by introspection r partly by examining problem solving protocols [Hiller ft 
Goldstein 1576-bJ, and partly by studying the literature on problem solving 
iPoIya 1957, 1962, 1965, 1967, L96B; Ko-wia 11 ft Simon 1972; SUssman 1975; 
Sacerdoti 1975]. We regard the tLTMlftdr) as neither complete nor unique. Part of 
the research program is the classlfleatioh of additional techniques, end the 
evaluation or alternative organiZational schemes. 

There are three major classes or plans in the taxonomy; identification, 
decomposition, and reformulation. Jdentificatioq means recognizing a problem as 
previously solved, Decomposition refers to strategies roir dividing a problfin 
into simpler sub-problems. Reformulation plana alter the problem description, 
seeling a representation which is more amenable to identification or 
decomposition. The figure suggests how these classes of plans are rurther 
subdivided in the SPADE theory. 

3,2. A Grammar of Plans: Fleming, according to the theory, is a process 
in Which the problem solver Selects the appropriate plan type, and then tarries 
out the subgoals defined hy that plan applied to the current problem. From this 
viewpoint, the planning taxonomy represents a decision tree of alternative plans. 
The decision process can bo modeled by a context free grammar (figure A}. 

Consider the top level rule of this grammar; 

ri: SOLVE -> FLAW * [DEBUG). 

The nonterminal symbol SOLVE is analogous to the nonterminal SENTENCE in a 
gramnar for language. In oer notation. Pi mean* that planning is first used to 
generate a plan, with subsequent debugging then being required to complete the 
solution. Since the plan may be Entirely correct, DEBUG is in brackets, 
indicating! that it is an optional constituent. 

The disjunctive rule, PZ, represents the choice -- in our taxonomy 
between the three mutually exclusive categories of plans; identification, 
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Figure J, Qjn A O ramaar 1 of Plana 


Pi; 

SOLVE 

-> 

PLAN + [DEBUG] 

P2; 

PLAN 

-> 

IDENTIFY ( DECOMPOSE j HEFOWTULATE 

P3; 

IDENTIFY 

-> 

PRIMITIVE, j DEFINED 

P4: 

DEFINE!* 

-> 

"dsa code" fc "gat file" 

Pd; 

DECOMPOSE 

-> 

CONJUNCTION | REPETITION 

Pd; 

CONJUNCTION 

-> 

LINEAR ] NONLINEAR 

P7; 

LINEAR 

-> 

SET | 5EQ 

PS: 

SIQ 

-> [SETUP] + <J1AINSTEP * [INTERFACE]^ 

P'S: 

SET 

-> 

C50LVE>" 

PIC: 

SETUP 

-> 

SOLVE 

Pll: 

HA INSTEP 

-> 

SOLVE 

PIZ- 

INTERFACE 

-> 

SOLVE 

PI 3: 

CLEANUP 

-> 

SOLVE 

PH; 

REPETITION 

-> ROUND E RECURSION 

PIS: 

ROUND 

-> 

ITER-PLAN | TA]L-RECUR 

PIS; 

ITER-PLAN 

-> 

"repeat Step" + SEQ 

PIT; 

TAIL-RECUR 

-> 

"a-top step" + SEQ + "recursion stop 


l Th« rules of the granmar arc written using the following syntax: 

disjunction: "a p b" Is read as, ** or U"* 

ordered conjunction: "a + b" i& read as, "a and b*. where the order it 

significant; 

unordered eonJuftetieft : "a h h" is road at* "a and h* t where th* order Is 
insignifleant; 

optionally: M EtI" is road as, "a is optional": 

iteration: "<«>** is road as, "a repeated 1 or nore tides"; 

lotted category; a lower case English phrase enclosed in quotation nsarki 
(»-9 m "repeat step'} describes a lexical item which is not further 
expanded in the grammar. 














Overview 


\l 


Hiller ft Gel dstfliPL 


decomposition, and reformulation. 

PZ: PLAN -> IDEW7IFV 1 DECOHPOBE 1 REFORM LATE 
The vertical bars Indicate that a choice is required. Other rules ate 
Interpreted similarly. 

The SPADE theory La not restricted to any particular domain. However, to 
provide concrete examples, most of dut papers use problems from elementary Logo 
graphics programing [Papert lg?la,bf 1973], Figure 5 illustrates the graiamar 
rules for primitives in this domain. Figure 6 shows our favorite example -- a 
typicel goal undertaken by beginners in Logo programming -- a "wishingwell* 
picture. Figure 7 Illustrates a solution ter the wlshingwell problem with Its 
hierarchical annotation according to nijr planning grammar. 

The grammar of plans represents a useful abstraction of the decision 
process involved In selecting plans from the taxonomy. Ve illustrate this point 
In the next section by analyzing debugging in terms of the grarrar. Later in the 
paper wf show how tb* theory may bo extended to include, not only the syntax of 
plans, hut their semantics and pragmatics as wall. 

3. A Linguistic Theory of Debuggin£ 

Often problem solvers must decide on a plan in the face of Imperfect 
knowledge and limited resources. Even carefully reasoned judgments made under 
those circumstances may turn nut tp be mistaken: debugging Is then requlrod, 
Given a grammatical theory Of planning* debugging can be analyzed as the 
localization and repair ol errors In applying granmar rules during planning. Tho 
linguistic analogy unifies planning and debugging by tracing the origin of bugs 
to various types cT erroneous planning choices. 
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Fignre 5_U rg-mar Rule s f or Lagn Primitives 


Li. 

pRirtimE 

-> 

LZ. 

VECTOR 

O 

L3. 

ROTATION 

-> 

LA, 

PENSTATE 

-> 


VICTOR 1 ROTATION | PEN5TATE 
FWMUfBACIt * 'number" 

I,EFT| RIGHT + "number - 
FEKUP | PEN DM 


FIGURE 6 WISHI HGWEIL PICTURE 





























ABBREVIATED HIERARCHICAL DERIVATION TREE FOR WISHINOWELL 
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IS 

3 . 1 . A Tnmamf of n.gv Sint* our planning rules mere constructed from 
nparamr. far conjunction, disjunction. end optiunality, three b „ lt tl . JMS „ f 
errors arise; 

I Sy7ltllCt1C *"*»■ ln W HlCh tlli basic grammar ls vlQlMsdf SUC}1 a4 whfFt ^ 
required co^Huct is mining; 

Z. bugs, in a semantic constraint arising from th , „ rtl<;u j ar 

problem Is violated, snob as Mien a syntactically optical constituent, 
noodoo because „f the semantics el the partionler problem. 1, missing, 

a. pragmatic bugs, i„ uhich a. tnapproprl.t. selection iron a s,t or 
mutually excltisiv* tfu/iffldi Is made. 

these bag types ere Hlustrated 1 « figure 8 . Although these classes nr. 
adequate to choree tone, many examples uhich arise ln elementary programming, 
additional categories oust bo defined to mate this tat.numy of bugs complete. 

3 J^_[ )iagnosis end Pepulr; Aa important espett of our research is tb. 
analysis or techniques for diagnosis and repair of planning bugs. these 
techniques can be classified accerdlng to uhleh represent.tlun of a problem they 
" C . the problen specifloatlm. (or model), the solution (or codol. the plan 
derivation, or the proceas state. Techniques far plan diagnosis can he further 
Categorized according td the type of planning bug hypothesis syntactic, 

semoctlc, or pragmatic. (further details of the debugging theory are presented 
in later sections,) 


In the neat tbr« sections «« famine «reral experipshtal euplichUcns 
Pr “ 0rdms wfllch KE hftya HJ Uttnd to irnfWnt, Jhr . presentation is 

««rdiH B the assets »r the inv«ti B i,ti« repros^tod by tb* out flr 
circles of rig Ure Z. u e must ewphasi™ two points; firit p that this division by 
aspects is ft crude first approximation, because Of the Considerable o^rlap 
irnpliod by a unified approach; second, that while thfr programs which hav* 
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FIGURE flfl - SYNTACTICALLY INCORRECT PLAN 

h necessary conjunct rs kissing 


TO WW 

10 TRIANGLE—USE- 

— ID-PLAN 


END 

wv.’ GET 

??? TRIANGLE UNDEFINED 7?? 

("GET" MISSING. UN GRAMMATICAL PLAN. 
DEBUG BY COMPLETING PLAN.) 

GET TRIANGLE FILE - 

FIGURE 3b _ SEMANTICALLY INCORRECT PLAN 


AH OPTIONAL CONJUNCT IS MISSING 


FOR EXAMPLEt "MW™ MISSING INITIAL SETUP, AND INTERFACE FOR POLE. 


TO WW 

10 HELL -MAINSTEF -r 

20 POLE — KAINETEP 


SEC-PLAN 



starts here 


FIGURE 8c - PRAGMATICALLY INCORRECT PLAN 
AN INCORRECT DISJUNCT HAS BEEN SELECTED 


TO SQUARE-INSIDE-TRIANGLE 
10 SQUARE 
20 TRIANGLE 
END 


INTENDED PICTURE: 



LINEAR PLAN — 

SQUARE AND TRIANGLE 
DESIGNED 
INDEPENDENTLY. 


ACTUAL PICTURE: 

































Overview 


17 


nnior fc Goldstein 


designed potentla Uy have practical applicability. we regard then primarily u 
experimental tools, which will serve tp test the validity of the under lying SPADE 
theory. We turn first to the normative aspects, describing systems designed to 
encourage and teach articulate top-down structured design, 

j_,_ Noma live A s pects 

How can wo judge whether a particular grammar pf plans captures, at some 
level of abstraction, the set of planning decisions whitb ought to be considered 
in solving problems for a domain? One methodology is to incorporate the context 
free grammar into a program editing environment, to augment and direct the 
capabilities of a human user. The critical question then becomes datemining the 
extent to which such a support systeo aids or hinders the user. This is the 
rationale for SPADE, an editor that incorporates our planning grammar. 

*,1, SPADE,. " A Grammar _ Bated Editor; SPADE [Killer fr Goldstein 19?6cJ 
is an acronym for Structured Planning end Drbu V9 ing Editor. We chose this name 
to emphasize the link, between our research and the structured programming 
movement. Dahl, DjJkstra, and Hoars 11972] call for a style of programing which 
reflects coherently structured problem solving. But n detailed formalizatton of 
what this stylo entails is lacking., Our efforts in this direction, therefore* 
naturally Supplement the work of DJjXstra and others. 

Suppose a problem solver is defining a Logo program for drawing the 
wishlngwall shown earlier. In SPADE, this is accomplished by applying the 
planning grammar in generative made. For example 3 

lo. What is the nans of your top level procedure? 

lb. >VW 

Za. Rule for UU Ij : SOLVE O PLAN + fDESU&]. 

Rule for WV-L is: Ft AH ■> I DENT IFV j DEC0HP05E ] REFORHULATE. 

What now* 
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Eb» >DECOMPOSE, 


In tills way, SPADE will try to encourage users to articulate their Design 
daclslona In top-dewn order. At the sane time, the system should offer ,„e u „ t 
the freedom to escape from this strict discipline if „„ alternative solution 
order teens preferable. Mere the ater Interrupt, ,o„- d „» n prompting, 
suspending ma> subgoal to ptirsua ajiotiier; 

$fl, Do you Wish to include tha optional constituent CLEANUP? 

6tK >LATEH 


7a. Vodr Pending goals aro POLE , 
7b. >PQLE 


and MELL. What now7 


The implementation or SPAM Involves assigning „ intarpretly, procedure 
to each grammatical operator. In perfpre bookkeeping of the user's goals. 

A, a simple example of the experiment.! otlllty or SPADE, the 
relationship between level, or expertise and application pf t„ p . d own planning cm 
bn ascertained from the frequency of osing the EATER capability. n Pr , subtle 
experiments along these lines will oksmine the use or urea in various planning 

contents s 


4.E. The KAIQobagging Assist ant!. SPADE keeps a thorough record of the 
user's planning decisions, called the plop dertvetlop. Because or this, 1, 1, 
possible to design . debugging assistant (RAID) tor the SPADE environment which 
embodies what we balieve to be a fairly deep notion of debugging. As the user is 
Prompted through the decision tree represented by the Planning grammar, those 
choices which might lead to syht.ctlc, semantic, or pragmatic bugs con be 
internally flagged by the system, l„ subsequent debugging episodes, RAID can 
alert the user to the relevant bug warnings, thereby aiding m fll . s ,o tll 
Moreover, the SPADE monitor cap then be relnvoked to guide repair of the bug, by 
reaming Planning In the contest nf the culpable decision (figure s>. 
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_MJ.tl.ftd vlca for Syntactically Inccinnle le P lanning Bu*j_s 


Id. Which subpoal would you like tn pursue? 
lb, >PoLE 

za. Rule for POLE” 1 is; PLAN -> IDENTIFY [ DECOMPOSE ] REFORMULATE, 

What new? 

Zb. >IDENTIFY 

3a. Role Tor POLE-3 is: IDENTIFY -> PRIMITIVE \ DEFINED. 

What new? 

3b, >LAT£R. 

The LATER cwmand causes further processing of tMs sufigeal to be postponed. 

RAID, the debugging coirrppiq^-JTt, creates a CffVetf t cocft time tf LATER cor?.wjfd occurs. 
The caveat records the fen that thU pert of the plan is syntactically 
incomplete et this poi.pt, 

Aa, POLE"2 postponed. Tour pending goal list contains the remainAny subgoal 
UFLb, Which goal would like to pursue? 

Ab. >WELL 


5 a, We have now cample ted the WELL sub goal. What now? 

5b, >RUN wishindwell 

The cove at recorded earlier Is c "defimn, 1- triggered by preMcicire execution of the 
procedure belay designed. If tAii occurs* tfre /ciflctioi? Of the caveat 13 to 
remind the user of the 3i/JTCi?ttic incorrectR-e-is cf the program, 

6*. Running W JEHl NOVELL at this time results in the bug man t Test at ion: 

Uhl DEFINED PROCEDURE; POLE. 

This is because WISH INDWELL is syntactically incomplete j It contains 
the pending suhgoal POLE-3. The recommended repair technique Is to 
complete the solution or the subgoal POLE-2. Would you like to wn’-k on 
POLE-3? 

6b, >Yes, 

?a. Vou were solving POLE via an IDENTIF!CA?IQH plan. You postponed the 
decision (POLE-2} as to which answer library to use. 

'flue rule For POLE-2 1st IDENTIFY -> PRIMITIVE ] DEFINED, 

What now? 



















Overview 


Hiller ft Goldstein 


2ft 

4.3. SHEKLOCK. -- A Computerizsd Tuto r Computational theories of problem 
solving hava important ramificatioris for education, kuth theories can serve as 
the normative Justification For a given curriculum, reveal critical knowledge tor 
the student excluded from the traditional syllabus, provide a basis for 
qualitative -- not nerely quantitative -- evaluation, and he Embodied in 
intelligent tutoring programs td serve as personal learning environments for the 
-student. This position is exemplified by SHERLOCK [Goldstein & Hiller 197G a ]„ 
SHERLOCK is an hypothetical computerized tutor which represents a long tern 
research direction rather than a detailed program design. S4HEB.LOCK. embodies our 
vision of Flexible, sensitive uses of computers to teach problem solving and 
enhance education. The other programs we have designed, each significant 
Undertakings in their own right, can also ho thought of as necessary components 
for SHERLOCK., 

SHERLOCK 1 s goal is to imbue a Aflottfiedgc of the SPARE thoory in 

novice prograimers. This does net necessarily mean that fifth graders must use 
terminology such as Corttext Jrse 5 r^mma r, it does mean that they Should 
OK patience, actively man ipli late „ and explicitly discuss problem solving 
situations which- highlight the planning and debugging concepts which the theory 
attempts to formalize. Let us illustrate what this might mean via 4 brief 
dialogue, 

SHERLOCK; Hello Debbie. 

What problem are you working on today? 

Debbie 1 >1 an going to draw a wlshingwell, 

initially in a less intrusive, j&ocJtmrtf fooAirt? mode, SHERLOCK might 
remain silent as Debbie typed in hpr code for a wishingwijll. Unlike the highly 
structured SPADE, SHERLOCK wi 1L not take an extremely active role in prompt In si 
tho Student. (Ue plan to experiment with the relative virtues OT these two 
tutorial stylos.) However, SHERLOCK, might intervene when difficulties wtro 
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encountered by tho Student, 

Debbie; >forward HO 

>riglit -SB 

>forward 500 

>0h no! Erase that last forward. 


SHERLOCK: Ok H p Forward 500" has been orated. 

DO you Wish to group the other 
lines together into a procedure? 


Here,, a simple rule of programm lng stylo ** the use of aubprocedures -- is being 
emphasized. 

ftany COaples Issues are raised by the design of such tutoring prograna. 
Our purpose In introducing SHERLOCK has merely been to Illustrate one potential 
pedagogical application for a computational theory gf design, The next section 
turns our attention to the synthetic aspects of our enterprise,, by Introducing an 
Al ptoblsEi solver called PATtf, 


5. Synthetic Aspects 

While context free grammars can represent a useful abstraction of 
planning decisions, they have limitations which prevent them froo providing a 
complete theory of design. To address this, we have designed PATN, aft A! problem 
solver. PATW, like SPADE, Starts from our taxonomy Of plans. But PATW takes the 
linguistic analogy one step further. An augmented transition network fATW, 
[Woods 1970]) is used, to capture not only the syntax of plans,, but also their 
semantics and pragmatics. 
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5 1, PATH — An Augmented Transitio n Network for Planning; FI pure 10 
provides a global view of OATH [Hold-steln 5 Hiller 197Gb 3, Here the decision to 
pur&UB an Identification plan versus a decomposition, For Qxaniple r Is modeled by 
tUl arc transition. Semantics are added, by defining a Set oF registers to record 
the problem description, proposed station, planning adi/tce, and debugging 
cnueatir Pragmatic information is also incorporated, by associating conditions 
and actions with various arcs. For Instance, an identification plan cannot 
proceed if the problem description cannot be found in the answer library. PATN 
elaborates our notion Of a plan, by associating semantic variables (snapshots of 
thfl ATW registers} with each node Of tlie plan derivation. One application or 
PATN Is as a module of 5PAPE, providing an enhanced set of features to aid the 
wser in conufiunicatins plans. Our implementation plan for PATH Is to provide 
SPADE with a mode of operation in which a progressively larger percentage of 
planning choices Ore made without consulting the user. 

5_;_2 . PAPE -- A ho d el of Debugging i PATH can mate nis takes. That is, 
PATH Will sometimes introduce what we term rational into its Plans, due to 
making arc transitions with imperfect knowledge of subtleties and interactions in 
tha task, duiraln Watu rally, PATH will como equipped wit It a cor responding 
debugging modulo (DAPHJ, Whereas RAID is designed to assist human programmers in 
rinding a variety of bugs (primarily by Plan diagnosis), DAPR is specifically 
designed to analyze PATH'S hugs, employing three diagnostic techniquesJ model, 
process, end plan diagnosis. Model diagnosis is the basic technique, ft amounts 
to comparing the affects of executing a plan to a formal description of it* 
goals, to determine if t and in what fashion, the plan has failed. Another DARK, 
technique, based on Sussmart's HACKER is examining the state of the 
process at the tiine o r the error manifestation. Plan diagnosis Is & DAPR first. 
It IS occninpl O.V examining the caveats variable associated with ViriCrUi 
nodes of FrtTN's plan derivation. 

DAfK could be used to provide additional guidance to RAID. This 
possibility illustrates tins synergism possible when normative, synthetic, and 
Analytic facets of a cognitive theory are studied in an integrated fashion. In 
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the next section we juries the analytic facet of our investigation of ttie design 
process, introducing PAZATh, an automatic protocol analyzer, 

6. Analytic A spects 

As soon as ona has an heuristically adequate theory of design, it is 
natural to ask, h C*h the theory provide an account of how people solve 
prob) i! ms?" r The traditional {s,g, t [Nowell 196&}) experimental technique for 
answering this question is the analysis of protocols collected during problem 
solving Sessions, Uhil't this generally implies transcriptions of tJKflA uloUd 
verbalizations, a useful simplification is to examine the sequence or Keystrokes 
fron a console session in a computerised data gathering context, 

6,1, Proto col Analysis as Pa r sing: The analysts task in such a setting 
is to interpret user type-Ida during a console session in terms of a theoretical 
model or the planning and debugging processes. Our linguistic analogy is helpful 
here, wherein w& define protocol analysis as the Construction Of an hierarchical 
description of the protocol in terms of our problem solving grammar. [Wilier S 
Goldstein 1376b] provides a detailed example of such analysis being performed by 
hand, lb that paper, we examine- a high school student's l.ogo protocol in detail, 
summarizing the sorts of insights obtained When protocol analysis Is viewed as 
parsing in this sense. 

Just as a context free grammar is incomplete as a theory of planning, 
likewise u parse is only a partial analysis of a protocol. The theory of 
annotation developed in the PATW wort leads us from describing only the itrucitrre 
to mere complete analyses of protocolsr an interpretation of a protocol Is the 
Selection of fl particular PATN plan derivation. Hence analysis should Consist oT 
linking protocol events into the data structures of PATN and of advanced versions 
of SPAGE. 
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6 " l ' pAZATf * ” A Parsar for Eleme ntary PrograppilFm Protocols; Manual 
protocol analysis is unacceptably tedious and informal. Banco [Hniar ft 
Goldstein ig76d] introduces the design for an automatic protocol parser, FAZATM. 
FAZAT* Will analyze protocols by matching them against possible solutions which 
PATN generates, PAZATM will operate by causing PATN to deviate Trout its 
preferred approach in response to bottom-up evidence (figure 11), Also, "buggy- 
versions of synthetic plans (including trrctioaci bugs which would not bo 
introduced by PAIN) can probably be rocognized. 


PAZATU's design is a generalization and elaboration of the coroutine 
search plan-finding procedure described for flycroft [Goldstein 1375]. Looking to 
computational linguistics for guidance, PAZATN has been extended to take 
advantage of powerful search strategies developed in research o ft speech 
understanding [Usser et il. 1575; Paxton ft Robinson 1975], as well as 

sophisticated date structures developed in work on syntactic analysis [Ray lS73 } 
•(apian 1973]. 


PAZATM will he constructed by supplementing PATH with a number of 
Additional modules and data structures. Figure 1Z provides a mure detailed block 
diagram. Om data structure, the PLAJOAftf, keeps track of the set of plausible 
subgoals Which have beau proposed by PATH. Another, the DATACKAHT, records the 
State of partially completed Interpretations. A preprocessor module will be used 
to suppress uninteresting syntactic details APd to perform preliminary 
segmentation. The preprocessor employs an event classifier to determine tho 
syntactic class or each event. Corresponding to each syntactic category, PAZATM 
will bo supplied with an event specialist which embodies the requisite domain 
knowledge for assisting an event interpreter in associating an event of that type 
With some synthetic SUbgaal. Since a purely top down or bottom up strategy would 
be too inefficient, a scheduler module is necessary to direct the analyzer 
through a best first COroutfee sejrdh. 


Just as PATN will be implemented by extending SPADE to the extreme of 
naver requesting guidance from the user. PAZATM will bo implemented by oxtanding 
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FIGURE 11 - TOP LEVEL ORGANIZATION OF THE PROTOCOL ANALYZER 
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FIGtlJtK 12 - BLOCK DIAGRAM OF PAiATK 
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SPADE to the opposite extreme. that is, in the pure PAZATN situation, the system 
ifuist infer the user's plan entirely from cede level events, with no explicit 
articulation of the Intarntdiate levels of the plan. PA2ATN will hi useful in 
increasing SPADE's flexibility in handling ambiguous events, and in alleviating 
What might seem, to some users to De en excessive allocation of time end effort to 
the planning phase* Moreover, systematic experimentation with PAZATN will 
provide evidence regarding whether PATH can serve as the basis for models of 
human problem solving. 


7, Conclusions 

Wo have studied problem solving for tasks which may be characterized as 
the design of artifacts; the outlines for SPADE, a computational theory of 
design, have been presorted. The n&rmative, synthetic, and analytic aspects of 
its role in the overall research enterprise nave been illustrated by introducing 
several experimental applications programs. The exploitation of concepts utld 
algorithms from computational linguistics is a recurring theme; grammars* ATV's, 
derivation trees, search strategies from speech understanding, chart-based 
parsers. We believe that our unified approach to the objectives of several 
fields, Utilizing methods from each, represents fl new paradigm which can provide 
benefits to all of them. 

Itueh remains to be done. While far greater detail is available in our 
other papers, not every detail of thn SPADE theory has been specified, Aithough 
almost all of the programs have been designed, even hand-simulated, tieme have 
been implemented. Neither the utility, the validity, nor the generality of the 
theory has been demonstrated. If the individual research, projects succeed, a new 
clarity will have been brought te the study of problem solving. If, perchance, 
they should fall, then the reasons for the failures should nevertheless provide 
useful insights. 
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